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Harry Merkovits 


i. Quadratic Probleme 
Suppose that variebles KR peveghly are to te chosen subject to 
Lisear constraints: 


i) Ea, Kyo by Lo lLyeee ty 
2) Day, X, 20, £2 mths... ,m 
3) %; 20 oe rere 


where Om, Sm, 0 <N, <N and the mtrix (a, ,) ie l,...,m, bas rank 
m, (otherwise the system 1s inconsistent or has at least one redundant 
equation). The payoff is a Linear function R = £ r, X, whose coefficients 
Ty are not known at the time the Ry are chosen. The Fy rather, are 
renion variables with expected values », and covariances 64, (including 


varlencss O45 = 0°). The expected value of R is 


k) Balu x, 


The variance of R is 
5) Vv =I on , xX 


Suppose further that scm decision-maker likes expacted payoff (B) and 
dialikes variance of payoff (V¥). Our problem fe to compute for ths 


decision-maker (a) the "etfictent combinations” of B and ¥, 1.e., those 


& 
fhe writer has particularly benefited from discussions vith Kenneth 
frrow on the subject matter of this paper. 


2 Sere 
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attéisabie: (8;¥) combinations which give minim V for given Bnd 
weximun $ for given ¥ (ade Figure 1); andi {b) the pointe in the X space 
associated vith the efficient 8,¥ combinations, i.e., the act of — 
efficient X's. : 
¥ : 


Figure 1. 
We 
ee 
al ‘“ 
on oe , 
ae Attainsble 8,V~) 
: \ | 
A) Combinations /<€— ‘Bfficiest . 
\ ’ 


3,¥ Combinations 


‘A computing Sechintaue is presented in this payer for gemrating 
the above efficient eets. An adaptation of this technique otin be used 
for problems of maxinising or mininizing quadratic forms (with the 5, 
"right" properties) subject to linear constraints. ) 

The prectical probles which first suggested the ebove computing 
problen wis thet of selecting @ portfolie of securities.” were Xy is 
the anount invested in the J” eecurity; the py and oy, are the expected 
returns ani covariances of returns from the various aecurities. In the 
Rixplest esse the constraint est is LX, = 1, X,2 0 A problem of 
very stiller stricture analyzed {ndepentently by B. 6. Houthakker, 


pera’ samara nraa ena 
Harry Merkowite, "Portfolio Selection,” Journal. of Fireace 1952. 
“ere Forse Bes Counts D'Encot,* Qshiora ou Sininatve A'Bconsmstete 1953. 
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is that of finding the expenditure on various goods as a function of 
income for an individual vhoge utflity function 1a of the fora u = La, Xj+ 
D>) @,4 5, Xj. & problem of mxinizing s monopoliet'e quadratic profit 
function subject to linser constraints is presented by Robert Sorfuan.” 
Another problem of this general character is that of suximising a 
quairatic Likelincod function where there is a priori inforaation con- 
cerning the velues of perematers to be estimated. Fow that raasombly 
convenient computing procedures exist for such quedretic problema we 
may be permitted the hope that atiil other classes of interesting questions 
can be reduced to this forn. : 
This paper wili discuss only minimization preblems involving the 
quairatic form LL 0,4 X, X, whose matrix (9,5) is positive semi-definite. 
The reader should have no difficulty in extending the results to mini- 
misation problers involving a, X; + ry» 0,5 XX; where (a, ,) 19 positive 
semi-definite or maximization problems where (s, 4) is negative semi- 
definite. 


ae ions 
According to customary usage we say: 
a) A set of points (8) (In Buclidean n-space) is ccavex if 
x!) 9 3 ana x!) o 8 supty x xO) + (1-2) (2) ¢ 8, ror any 0 <2 <1. 
b) A Set 1s cloged 1f K,,...,Xy.06 —PY amd X yeorpK yore @ B 
imply y e 8. 
c) A fungtion £(X) is convex over a cet 5 ir x) og, eg 
ona Xx) + (ra) 227 8 amy ¢ (x x) 4 (1-2) 82) <n e(xl8)y y 
(ver) (x!2)) for att 0 <a <1. 


‘Application of Linsar Programing to the Thoory of the Firm, University 
of forn 
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4) A function 10 stetctly conmx over eset 8 i¢ xl) e 6, 
x62) es ant BE git) + (1-2) x(@)7 28 teply £0. xi) + (1-2} xi2) )<, 
nets) + (rr) et!®)) top 013.0 <2 <1. 

fhe eat of points 9 which satisfy constraints 1), 2), end 3) is 
@ closed, convex vet. Variance (¥) is a pogitive omal~definite quadratic 
fous, L.e., a Gic Xj %, 2 0 for ald (X,r---,%,). Tt ie also convex, 


The covariance estrix (¢,) is non-tingular if and only if ¥ is positive 
definite { t.e., oe Ose R, %, > 0, of (%,,. 02 sly) # (0,40440) f which 


in turn i true if and only 1f V is strictly convex over the set of all 


% 
x. 


Tet VIX) D0, for aif, 16 dus to the Yeot that ¥ is the expected 
valut of e square, E(r-Br)*; and therefore cannot be negative. That 


les} # 0 a : 


material found, ¢.g., in Bivkboff anf Maclane, & Survey of moeeen Algebra 
Chapter IX, particularly ecetios 8, pp. eae . ne isnlicetions 


positive definiteness and cenlsdéSinitensss for commxit may be seen es 
fétlows: Let Ga = (6, 4). tet ¥ and Y be eolum vectors; Xt and Y' be row 


veetors. € is syametric so thet C= C! and Z'CY » Y'CX for any X,Y. We 
Wish to see the ixplications of 


“, 
(1) ZX > 0 : i. 
(2) XX o 0 4am ¥ = 0 
for the difference : 


Ds f RICK + (ier) rer | = fou + (lea)Y") Ox + (wayy) } 
Sxpanding the cecond pele eae eek a 


De A(den) . {zx ~ ACY + rer } 


= Maa). {ar-r) ¢ (z-x)} 


fen (2) duplias » 2.0 for ail 2), Ageunptions (1) and (2) uly 
sary edi. Co: Reedy Cob ta elite fon ca KTH, Etta Ye 
ve fing AME > O'fur all ¥ 4 Ce 


SBE Ae ame Es yet ce ge hee Meet iat on ely om Sanaa amet, eat 
a ee * ati < Nae Yee ae eee 


We will sesume thet § is not vacuous. We will also assume that 7 
is strictly convex over the set of X's which satisfy the equations 
Le, x, = by, 1m dyes sy D 


a f 
Thig assures us that V takes on # unique xinimum over & apA that if 


Bu 2 is attainsble in 8, then V takes on unique sinimum over the set 


aA” {x [Eu x5 2%} 
If # function is convex over # set 8 it is convex over any aubsst of 6: 
therefore | o,,{ 7 0 implies that ¥ is strictly convex over {x]E a gt, = >, 
i = Lyeee si | . This is not a necessary condition however. Mecesesry 
and oufficient conditions on A and (o,,) = C are dlecussed in the footnote. 


“Since equations 1) have rank m,, m, variebles ani the », equations 
could be eliminated (as in footnote **) to leave a ayetem with F-m, 
verisbles end (m-n, ) +8, inequalities. V is strictly convex in theve 
Nem, varisbles and therefore the associated quadratic is positive Aefinite. 
Let Y be any point in the space of the N-m, variables satisfying the: (ia-m, ) + 
H, inequalities. ‘The points which satisfy these inequalities ani have 
V <V(Y) forma compact, comvex set. Since V ie contimous it attains its 
minimum at least once on this get. Bince it is strictly convex it attains 
ite minimum only once. The same ergument applies if the constraint 

y b; x, > 2° 
is added to the (w-m, ) +W, inequalities. 


ag 

Suppose m, > i. Since S30 ) bas reck m, we oan write, 
Sane 

after perhaps relabeling variables, 


Sa°**Su, 4 ne: Sater *p, od 


tea) LA) awed (ET, 


or alt) yi) + al?) x62) = b where a(t) is nen ginsuler. We thus have 
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Se. The Critica). Ling : 1 ae 
vet up fleck. fete the aqomp tha atalar Weck than Te of 


finding ali (B,¥) efficient points. . @uppose ge wished to mininize ie - 


subject’ to the equations | 3 . 
Bay, aya - £m Lyese pth 

without regurd to the unequalities 8 eni 3. A necessary condition 

for a wikis is that Xp +e0pXq be & eolution te the Le Granglan 

equaticas, 


6) 622 04. a, x ~ 20d, By a4 % 20 
, rs] , : - 


ks Ly cep 


ghB)  caltdy-by . (qlh)) “2 gl2) 22) te con expreas ¥ in terns of 
xi?) oy substitution, i.e., 


1) (1)- (1) “L (2) 
BO). ("0") « 
. i 1) 


Va xtCK ow (a0)! xf) "yg (i) | 
i] t q (1)-2)) (2)-1,(2) (2) 
= [tvs ur 0) - (4h?) "p (2) a) at] ff ; ).( an. 


eo (pt abt)t-2 40). e 7 ol ) : woh 2)g2)*g(2)"-2. ry Q (als >| 
Q 


» 2)" {cal2)'y2) 2) ‘ aya al2)} x(2 


¥ ie etrictly conver for all #2) s¢ ond only tf the last (1.2. the qudratic) 
tera ig strietly. conves. hte Le co. df exd only : 


sf 
cab®)’ AHR 6 e “a ROM ) 
rs 


is non-pingalas. 


1.@.; 
z 
7) jal Ging + Und, } ay ke Lycos 
| 8) Lay, qe Le l,.oe ty 


& Given the assusption that VY ie strictly convex over {xfic By 4 x, & Dy» 
fo ted, } it follova that 


9) ea Cun “a eeo “ny 


O19 eae Ons May eae 4a 


ete YQ : oo6 
“1 iw 


*n 2 eee i 0 eee . 


is non-singular. since a stetotty convex ¥ take én e-uitgie xintous 


Oexe O 


wt 


on @ convex set, the unique solution to 7) anf 8) te this minimum. 
Hext consider the problem of minimizing V subject not only to 1) 
but alee to the constraint that 3 = B,, heey 


— re 8 et he Mey * 


% 
If m, = 0 the statement reduces to one proved in the footnote of p. h, 


Suppone m, >i. ff ¢ a 1s cingular there is a vector /Y\ ¢ /0\ such 
e AO d ) 


nee Cee ae 6 we, (i) - (") 


ee ee ee ere 
y¢0in(Y) above, WY) = Yor @ YAN » (AL) a = 0 
Lot X be any point in = {x | ax = >} waawe K? = (%, 5000 ,Xy) 


(m. coutinuct p. 8) 
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We mst distinguish two cases; 

Gass 1: Toe ror vector ( parses ey? can dé expresaed as e linear 
ecubination of the (ayy sree sdgye i.e., thers exists Op rree ry guch 
that Z 


= CByreees ro) 


Case 2: There does not exist such a Linser combination. 

As i9 hown below, im Case 1 only one value of B, say B= 2B, is 
attaimivle. Therefore if we require B 4B” no solution can be found; 
if we requtre B= B equations, 7) end 8) give the minimm. In Case 2 
the matrix 


' 2 oes 
bt» (b,, by) 
A(X+Y) © AX +0 = bd; therefore H+Y is in B : 
¥(X) = X'CK ‘ 
V(K+¥) = X'CK + OXCY = X'CK + OKA = XK + 'r 
V(2/2% + 1/2(X+Y)) = W(X + 1/2x) 
@ KICK + X'CY 
« X'CK + 
= 1/2 V(X) + 1/2 V(xY) 


Thus contradiciing strict convexity. 


"If a'A oy! ond AX © b then Be y'X = QAR = ab 


r 
+4 
! 
4 
& 
4 
Z 
; 
4 


OMe sat gett meee! oe eA -ennmreenestincs 
- 5S webcnvetmens y 


Dm 


wat ana “Saw Pa 

6 ere OC eee ¥1 

m jathn “ow F : 
aa O.+. O 


a F 


‘ #1 one 5 «4 Oo. O 9] 


is non-singular” and therefore the equations 
1) Le Oy, %, + U-a Day, - dp by = 0 


12) Day, X, 2%, 


3 2 Lyeneylt 


i= Ly eee iy 


13) Ep, %, = 2° 


have a unique solution which gives minimm V for the specified BE. If 


we let 2° go fran -coto +oothe solution to 11), 12), and 13) traces 
out @ line in the ({,\) space. This line may also be described as the 


solution to the following N + a equations in N + Dy + 1 unknowns: 
my 


1h) Be O5 % ~ Ra dy ~ dg by 29 J = Lyset 
15) & a), %, = d i= Lyeoe,my 
or 
16) Zon, X, + 2 (-24) Ory 7 Ag Hy j= 1,...,8 
17) La, Xy = by Lo l,...,m, 
for -00< Ay < + 0° 
re fact, that 


“Bame proof a8 in the footnote on page 7 using the 


© has rank m + 1. 
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Bince the matrix of equations 16) and 17) 1s non-singular, given 
our assumption of strict convexity, they have a golution for every | 
value of hy, whether we sre in Case i or Gase 2 above. In Case 1 the 
values of X,,+<.,%, do not change (only the values of the i's change) 
BS dy goes from - 90 to +00." Tt Case 2 the X's as well ac the 4°e 


ro 


change. In Cage 2 we cen define W(E) to be sinimm ¥ as a function of 
E. Dy * i Wz) mist be strictly convex; therefore B increases 
with ),. In Section 1 we show that 9() is a paraboln. 


4, Critical Lines 4(3 
The set of points (X,4) which satisfy 16) and 17) will be referred 
to as the critical line # associated with the subspace. 


Bu {x| Ea; Kaw dy for to Lyessmh 
Critical lines will aleo be associated with certain other subspaces. 
Let X, y.0+5X) be 8 gubset of variables. Let 
‘i J 


Dey, Xiu by in Ay aseesdy 
be a subset of the constraints 1) and 2) with the inequalities replaced 
by equalities when i >m. Let “2 be the ordered set of indices 
fiyre+s ty } j let J be the ordered set [dpreeredy } Ya will be 
particularly interested ine! end ¢ of the form 


18) wt ” 1,2,+0+,M;, ta aureeertg} where I 2 my 
19) } 3 (Syeeeeodye By the ot} where OSL S45, 


err G2) @ ++ Q)4 


mm (63) (ose) -8*@) & +9) 


‘ 
{ 
j 
i 
t 
‘ 


21) Bo = 


also submatrices 


Iflon = 0, 2 is empty. In this case it will sometimes be convenient 
to think of Agg es having no rows and J colums. fo every ,}) 
tatiefying 18) and 19) we «associate a subspace 

BOS} ) = {x1 = 0 tor 3 #y, Agg %° Bah 
If Ay, has no rows this reduces to 6(}}) = {x | x, 2 OQ for j ¢ y} 
Since f and |} satisfy 18) ani i9) o(3,)) < 8. Since ¥ is strictly 


convex over § it is atrictly convex over a,%). 


: — ire agente Gages Sata oS Sy Vytigtnget, Mae ad iete Ne ao ee Ghee ni eae oP haart, vay den eee 
wn, 5o PNT EEE NEE TEE eee ee paar eran . 7 % 
uci i semen £% See ee SRSA 
teh Paget econ GES PARE Sate ar RES 
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As has a rank of I or less, TE yy hes rank Z. then the matric 


Sq Asy 


e+) # 2 i 
SY Ags 0 ; 
is non-aingular. (This is a special, ease of the proposition proved in 
the footucte on page 7 .) Tf by bes rack less than I, No, is singular, 


for its last I rows are not independant. Vor every (),4) catiefying | 
18) end 19) mnione Aa, Hae: 162m Cum to te mabee oF 416 3NE ee 
defing the gritical line 4. to be the ast of points (%,,...,Xy, 

My oroesh,) Which satiofy 


25) x, 20 for 3 ¢ 4 


420 frag 3 
and 
x 0 : 
-l -l 
a i (,) "hy ( ) 7 
d v 
3 
Equations 25) may be written ia the forma 


i "3" as * Pays mw <k, < : 
21) a * a Oe 


Rqustions 26) by themselves are the projection of 46,4) outo the 
X-epace. As with 5 anf Z we have two cazest 

1) Only one value of B is obtainable in 8(2,(-) ent the X-pro- 
gectien is 6 point. 

2) ALL values ef B are obtainable on4 the X-profoction ig a lim. 
Ghis lize a6 the est of X's in O(%,)-) hich give mint ¥ for cons Be 


28) B, 70a, x, - by £4, 600,m 


bs] 
av-225 1, 28,,%,°2%h wb 
2) nerf i tO ac) 


rs] a, 


Hl 
. Po pn % + G Chg) Oy y > By Ag 


Congtrainte 1} and 2) etete thet 


5,20 8 86toris Ly oo 9th 
B,20 for £m wm thyees ym 


Along any critical line ve have 


X= 0 for J ¢ 4 
30) y* 0 for je 
5, 2 0 for Le 2 
, 2 0 for i.¢g 9 
Also, from 25), letting n° be the (8,t)" e1enent of "Ge we have 
z J 
31) x, e@ E ahh, (5 a 
Js hed 4, hel 4, | 2 
a a <i Lor 6 4 L,eoed 
32) 2, = si ney, ned, - ; ners b A» 
1, hal hel Jy 


oa, +B, hp for B © l,.se,k 
« 6 
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Prom 26) and 29) we have 
a Py : 
# FB e(brary) » 
= os, + a Tie | 
18 
3h) at 0458 Oy, - Fai as, 
‘es 355 Pa,” ary Mtg Paty” ns) s 


mt aye 


A corollary of the results of an important paper by Zutm and 
Rucker” is that a suffietent condition for a point X to give minimun 
V for a act 


a” {x E uy X 2 Bf 


%,2> 0 for J < N, eniin } " 
35) m2 0 for § ¢ | : 

§,20 forid J 

A, 2 0 for 1 >m, end in 


end d, 2 0. If Ay > 0 the constraint is effective; if B, were inercaged 
an equally lov value of V could not be obtained. If lp 2 0, the point 
gives minimm V in B. In either case the point is efficient. 

It will be convenient ot times to employ the following relebal 
of variables: 


“E. ue Kula aie A. W. este Fogel Wenger in bEe ag ain 


- % for k # 1,...,¥, 


36) s The for k = Hyth, 0,28, 


en 


s Stk - aR, for k = 28)+L,...,28, + mm, 


“ec " e+ Om - m= 28, fork = M+ m-m tyes, 
an, + 22 - 20, 
Also 
37) K = 2%, + 20 - Qn, 
and 


38) X= {the set of k which identify the variebles in 


equation 30 I 


fhus on any critical Line we have 
39) ¥, = 0 -forke # 


and @ point X is efficient if it is a projection of @ point of a Gritical 
Line with ; \ 
ho) v, > 0 fork ¢ 


41) 2 0 for k © 1,.00,5 


2: axtersections of Critical Lines; Non-Degenaracy Conditions - 


Im the computing procedure of the next section we move along:a 
critical Line until it intersects a plene v= 0, kw il,...,K. Then 
either one row and the corresponding colum is added to HU, or ome row 
ane the corresponding colum is deleted from M. This raices two 
questions: (1) under what conditions will the mtrix obtained by such 
additions or deletions be non-singular, and (2) hoy ehould the new 
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inverse be obtained? The latter question will not be discussed except 
to note that the eae of the old inverse is of great value in 
Ovteining the new one. 

Concerning the forasr question, suppose My, with U9 satisfying 
18) and 19), i# non-singular and thus défines a critical line 4 Suppose 
2 intersects (but is not contained in) the plane v, = 0, L<k<Xk. We 
distinguish four cases depending on whether v corresponds to an X, an n, 
srora 5: 

1. The deletion of a vuriable. Suppose 4 intersects a Plane 
Ky 0, J 1,++.,%y. Suppose that J is deleted from the set } leaving 
the eet }". ts Msg  non-einguler? We may suppose without lose of 
generality thet j = Jy and that Spm therefore be written 


ka) Agg = (a Ay gs) 


re Ag a 
where @ is the column to be deleted. The matrix L 0. ‘. has 


either rank, Tor I¢i1. If it has rank I, then 


Go4 AS By 


43) : . 
m nw . 
‘ ; Js a M 
8 
Spf 
6 
1 o..<e Ooee G (9) 


fa singuler. In this case tht equations 


a Re ee : 

Thie involves procedures similar to these used in rezoving a 
varieblie from a rearcesion eamalysis or modifying a basis in limcor 
programing, @.g., Geo R. A. Pishor, Gtatistical Kothots for Rerearch 
Ueskora, p. 163, ani R. Devfean, Activity Amiysis ef Production ona 
Ailoestion, 10th Eas, pe 358. : 
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x ° 
4) # if = 4 
s 
b 


oO is 
Make, 


‘ a 


have etther no solution or en infinity of aetutions. tise $f Wt) nae coe 
solution, 1.€., ‘$2 2 intersects. x » 0 (but is not contained in 1), 
M ig non-singular and the rauk of CP is 1 +1; hence the 


rank of ce is at least I. But the resk of (3 *) = the 
Os.<0 Oces 


rank of Ay Therefore the rank of Nos is I ant K is non-eingular. 


wg? 
2. fhe deletion of a constraint. Suppose 4 intersects (but is not 
contained in) A, 70 fori >m,. We my assume i = 1, and that. 


45) Aoy Loe Agty 
a’ 


Ai has rank I, ‘omy 


3. Addition of a variable. Continuing the conventions uzed above, 


has renk I-l; therefore M ary ia non-singular. 


~~ 
if Age has renk I, so has A 


So = (Age @). Therefore H., , {# non- 
singular. 


*} 


4, Addition of a constraint. If ¢ intersects but is not contained 
in the plane &, = 0, 1 > my, then 


46) “49 Ay wh 


(where a' Le the roy of coefficients of tue naw constraint) is non-singular. 


Therefore (*¥) 2 Asn bes rank T+ 1 ani M is non-singuler. 

She tracing out of the effietent act io simplied if certain “aceidenta” 
do mut occur. These accidents are described in the following “son- 
Snaenitncy? conditions. Poe next sagtion of this peper presents 
computing procedure for deriving the set of efficient points when all 
non-Gegeneracy coniitions hold. In sections 7-10 these comlitions are 
relaxed. 


Condition 1. On no critical lise do we have 


o7¢ 


Ve * Oy + By Ape 0 fork ¢ % 


Coniition 2, On any given critical line #4 we do not have 


“a, ‘ 
os 2 ace foe ony Spt Pet 0, 


Pex, #0 
Condition 3. B is bounded from atove in 8. 


We will, let L, stand for “the Linear programming problen of maxtatsiny 
% mbject to constraints 1), 2), ani 3). 

Condition &. Ly has @ unique non-degenerate solution. 
Coniition + implies condition 3. 


AlLgorith- unter Conditions 2 through | 
acca thet ey Aftions 1 through 4 are setlefied. Contiticn 


eS pe OS tesa ORNS a re a tin 


& depites that tha eatime solution to ty bast” 


F<) 
She following exe corellnries of the tasis and pricing thoorezs of 
iincer programing. fo, Of, Coorg? B. Tuntsig, Alex Orden, Fhilip 
Wolfgo, “Sha -Coneralicsd Ginger ethed for Ninimieiog a Lincar Porn undor 
ieee cebeere4 Ecotenints,” Pasttse Jours- of Enthoraties, Vol. 5, 

Sy ¥ 2F39% 
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a) exactly m variables X, and be are not at their lowr extreze 


b) A ) (wrere gf) ineludes all i with as = 0 and pf) 


49 (1) ga 
includes all j with x, not st ite lower linit) has rank equal 
to the muamber of its rows 


c) There existe "prices" Pp, and *profitabilities” 3, guch thet 


W7) pp >O 3¢ 5 = 0 for i = mtl,...)m 
48) 20 8 1f §, >0 for 1 = m4l,...,m 
49) ge BP t vy 


50) 8, = 0 for j= W+l,....¥ andforX;>0 J <B, 


Sl) dy <0 ford,=0 js, 
The matrix 
“9 (2) ya) AG (1) git) 
A (2) ft) ° 


is non-singular and thus defines a critical line 2) along which 


x 0 4 Py od 
53) yo). + {oh |) oy 
" we ght) : | 


Since - AAD) git) "R(2) 2 Pea)? if (a) (2) aatiefy 53) Lor 
dp = 0, then 


52) My) * 


/ 
A 


x 0 u | 
(2) —_ , y{2) 
5h) M, May PM) . e) ( 0 Xg 


for all A, 
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Thus i) has 


55) yo) * ta) for all by 
aoe ag (2) * Pc) os 
Fron 47) 1¢ follows that for sufficiently Large h, 
4 >0 ford >m, andin & 


ng? Eon % > Coys + upp) 
56) 3 
m Bog, % ~ Eeyy My ~ (ags Py + ugly 


51) implies that for sufficiently large dp ny > 0 for J ¢ +. Thus 


for sufficiently large dy 2) satisfies inequalities 49). 
(1 


aia 


plane n, = 0 per eal » 0 for ie. (The X and 5 do not vary 
along 2™),) re it Me O then X° gives minimm V as vell as nexium B. 
Suppose nt) >0. Non-degeneracy ergs 2 implies s°*) intersects 


) be the largest value of ip at which iM) tenaecte 


only one plane n, = 0 or dy =o at x2), In the former case we afd § 
tot; in the latter casa ve delete 1 fran @, to form 2'2), p) 


the new matrix May ° (2) #(2) is ton-singular end Gofines a erition.: | 


line (2), Suppose for 's moment thet it was “so « O which a) 
intersected at id), Oa 2?) we have at a, = att ) 
4, >0 for i >a, and e 0?) 


57) ny > 0 tor 3 4 9?) 
$,>0 trig DL 


a 
{ Be” for all othor $<, ante 42) 
j sy eo 


N PS + < . 
sts Sere Nn vatithcee Bin aremBainothe sone n Reaee See Bem Sh Sey 
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Ap always x, 2 & + Dry along §®) - Non-degeneracy condition 1 assures 
0 


b7# 0. If b <0 the projection of £7) youta ve efficient for 2." > Ny 2p 


where a > ft), Thia is eee a bd >9 and J?) is 


efficient for rf) 2 hp 2 (2) where 2) > 2), Sinilar remarks would ‘ 


apply if ») first intersected 4, = 0 and 1, was deleted from a 
¢] 


{2) is the highest value of he < ft) et which £2) intersects a 


plane v, = O for k= 1,...,K. If this 4s enn, ve again adda J to }. 


If it is ad, we delete 1 frm 3; ifad,, we adi ito; if an X 


we delete j from $ We form M3) and 4/4) sccordingly snd find by < (2), 


This process is repeated until ), = 0 is reached. At each step (a) Hi 8) 


is non-singular and if v, is the new variable (n, X, 4, or §) which is 
a 


no longer constrained to be zero we have at yfse1) 


58) v,>0 fork¢k, and g x 


v. = O 
8 


By condition 1, b,, #0 along \8) Gegegin Below” Ghat we haunt 
8 
(3) (s-1) (s 
have Cees cee oe £ is efficient for \, Ze 2s 
where aa > ae) Bince there are only ea finite number of critical 


# 
Since b # O the X-projection of the critical line is a Ling yather 
than a point. eae this line E increases with Ae ir hp > * were 
1 


feasible then EB >£E ) « max B would be obtainable, which is impossibie. 


ee 
If x, is an X, or 5 vk, <0 implies that there are tvo distinct 


points which minimize V for some B > pie-l) , which ie impossible. This 
argument also applies if ‘ isa dy or n F unless the X-projection of the 


new critical line is a polnt. In the latter case we note ae the Kuhn and 
Tucker conditions) that ar efficient point gives minimum Q dp) 2 V - AB 


subject to 1), 2), and 3). Yor fixed dps 7 ois) has & unique minimap; if 
V, <0 then two distinct points give minimm Q(r,) for some dg > hy! 
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Linea, and each can satdefy inequalities 406) for only one seguent 
A, » 0 is reached in a finite mmbsr of steps. 


Let us now drop pon-degensracy comiitiona 1 and 2 but still 
assum coniitions 3 ani 4. We will use techaiques analogous to the 
degeneracy-avoiding techuiques of linear programing,” 

For every muther ¢ we define a new problem P(e) as follows: 


minimize Vie) = 22 o,, X, x, + etx 


J 
subject to 
59) Das, Zim by + etl 1 = 1,.00,m, 
60) Le, x, >b, + ett 1 = m+h,v+.,m 
GL) X, 20 d= 1,...,f, 


; \. 


For sufficiently small e the unique, optimal basis of ly, is fessible 
and, since it still satisfies the pricing conditions, is optimal. 


"tn linear programming these techniques are generally not needed 
in practice. In quadratic avoltrery selection of v,, = 0 
with b, <0 to go ixco may (or nay not) prove adeguate. In Kay 
cace ws degeneracy band) ing techniques are available if needed. 
See George Dantzig, Pik pepo on of the Simplex Metheé to «& Trans- 


portation Problen,® 32 Of Production and Allocation 
Malling C. Koopuane Se ae ““iptinalisy api Dogonsracy 


in ag pts ap Eoone=trics, Vol. 20, Eo. @, April, 1952, 
p. 2 


Pe 


a SENT Merete 


ew cube beneh.. See 


* ae 
ee a 


As we will see shortly for sufficiently amli e P{e) satisfies 
non-degeneracy conditione 1) end 2). We will also see that for a 
suffictently saall e* the sequence of indices (o-4)° associated 
with the eritical lines 2°), unter hp = 0 is rosiched, is the 
seme for ell P(e) for e* >e >0. If we change indices (>) in 
the same sequence as P(e) for amll e, if we let 1, decrease along 
any critical line when 1t can without violating v, > 0, until we 
reach dp = 0, then 

a) ve will pase through a finite muber of index aste each 
associated with a non-singular Moor before we reach dp «= 0. 

b) since v, >0 is maintained we have the desired sclution 


to the original problen. 


Along any critical line of P(e) we have 


er (ag | = We (m5 ee ) he 
& 
+ Ke : 
opt 
aia 
or 
Tay 
6 as ‘ Ly sh #{h) 
3) “a: Pai Sie bel, aie 
where © 1) © dy, (2) @ dgpeeesf(Ied) M4 
or 
6 ‘ 
mis Nae ae a Cn 
Siniierly 


yotesn eith) 


3 
My 7M, * Aa,” hal 
Hh ae tras, Ce) 
x Hei 
OF) Fy 0%, + Bay Met hy My Py (ec) +0 


"OH. * Pas Me Pe te) 
66) Ty ny +B ny Ay + aa 43, Pay, 6°) 


x 
i d 
gal, iJ dt, (<) 


ean +H ny dy ep a fe) 


e : 
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6) By,le) for je 
6) p,,(e) frie > 
9) Pa, (e) twig & 
7) pyle) for J ¢ } 


None of the polynomiale listed above have ali zero coefficients, end 
no two have proportionel coefficients. For: each polynomial of 69) 
and 70) has a term with a coefficient of 1 which every other polynental 
has with a coefficient of zero. This Leaves only the possibilities that 
some polynomial of 67) or 68) has all zero coefficients or two of these 
polyncateals have proportional coefficients. Both these possibilities 
imply that w* is singular anf are therefore impossible. 

Sines ay fe) has only a finite muber of roots, for ¢ suffleiently 
suall 

Py, Ce) #0 for k ¢&. 


TL) Vie = Wye + Bure dy + Peale) dtl Me aiats 
cannot be identically zero for k dX. The critical line intersects 
sre been emcee 


7m) ye Se Mt 
Ply Put 
and the plans 


v, = O at 
Xo 
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TB) ge My - Mae 
Pek, Puke, 
If, say, 
ve, kg 
7s > 
Fay Py 
then for sufficiently gmall e 
> 
On the other hand, since 
Pyp, (€) - Pyn(®) 70 hy, ky Xe 
has # finite number of solutions,for cufficiently small ¢ 
Mg ¥s 
even if 
yi % 
75) es = 2 
bg Vig 
“Py, (e) 
Ase ——>O the amallest power of e dominates; i.e., if, say, Ky 
Plc, 


has an algebraically larger coefficient for the first power of @ then 
h' >’ as e~—> 0. If both have the same coefficient of e then it is 
the coefficients of e° thet decide. And so on. 

Since there are a finite number of critical lines and a finite 
munber of planes %,* 0 there is a single e* such that for e* >e > 0: 

P(e) eatisfies non-degenaracy conditions 1) and 2); and the order 
of the index sets (¢2-)° 1s the came for all such e. 

The me are needed for other purposes and are thus available for 


resolving degenoracy prodiless. The other coefficionts of ple) can be 


2 aes 


ee ON ate AD een ates coeenl, ah, * Meee! 


ee eee 


carputed when needed. 


8. The Algorithm when Ly is Deganerate but Unique 


Suppose that the solution to Lp is degenerate in that one or 
more of the besis variables X, or 5, 1s “gecidentally® sero, but is 


unique in that 5, <0 for ali X, not in the basis ani p, > 0 for ali 


7 not in the basis. 
The constraints of Lp may de written aa a system of equations 


including the 5, as variables: 


76) 8B & 2b 


If B is the submatrix of optimal basis vectors and if % and 75 
are the optimal basie variables then the optimal solution is given 
by 
TT) % 28> 
a 
while all other variables are zero. After we solve ley we may modify 
it, forming L,(¢) as follows 


~ fe 
7) a(2)ob+8 e for ¢ >0 
€ 
pael 
vn 
where ry is the gum of the 1” row of B. 
Then 
(c) = e 
79) ai sae: 
5 (e) : 
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Bu 


t 
’ 


Thus the original optisal basis is still feasible ani therefore 
uniquely optimal (since it still satiefles the pricing relationships). 


Also for e >G 
X fe) >0 for ge } : 
, fe) >0 foie & s 
7 | ks 
aoe . L 

ase ——> 0 


The procedures of the last section which apply when i, has a 
unique ead non-degenerate solution apply with essentially no modification 
if Ly has @ unique but possibly degenerate solution if we let Pe) be 


» 


ain VID ay XX, +L ex, 


subject to 


80) Ears x, sb, + T% e+ oot for i « Ly soe, 


ry oT, i, 2, +r, e+ glitiel Yor 1 # My tl, oof 


The solution to Le(e) is non-degenerate for sufficiently small e. Along 
any critical line we now have 


I 
$1) Xe Ay et ey (e) (hems) rs 
“Ay, Pay dat Sy, 


I 
82) - a ” re > Pa Mp te aa {e) - (i ey 8 
| \ 
"Ha se Gy fe) 


Se to ec a 


i. mee aerate a 
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c 
83) 44 2g, ¢ Bay de + Jy te gg Ce) 4 ertieh 


mGys + Bey Mp t uy (e) 
Pi 
Bh) nye ange Png ree 2% 04s ayy Ce) 
Z 
<5 ( jth 
is Ss ere 
= On, +B ny dp ta ng fe) 


vhere the p,(e) are as defined in 63) through 66). Since no Re) can 
have vero cosfficients ami no two can have proportional coefficients, 
the same is true of the ale). 


9. The Algorithm vhen lp ia not Unique 


A non-degenerate optimal solution to Le is uniaus if and only if 


85) 6, <0 for X, not in the basis 


P, >0 for §, not in the basis. 


If Ly, has & degenerate solution and 85) does not hold, then either the 


solution is not untque or else only the optimal besis is not unique. If 


Ly does not have a unique solution ve mst find the point ¥% which gives 
minimum V for B= B= mx B. If only the optimal basis of 1, is not 


unique we still must decide on the O} of our first critical line. Both 


these problems will be recolved in the came mamer. Our procedure my 
be considered a2 a special aise of either approach 1 or approach 4 for 
ninimiginy a quadratic subject to liner constraints described in 
ecction 12. 
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Let us create © new linear pr 


sing problem Lfe) by aiding 
& constraint to ani modifying the form to be maximized in Llc). The 
equstion we add is 


K 
86) ba yg Sy - Wg" Bel Sony - eo 


If we edd 5, to the optimum basis varisbles of i,(¢) we have a feasible 
basis correeponding to & solution with 


Kak +e yee 
m 6 we 
a7) a ie , @ 
Fg=t 


Next let us replece the objective function B= LyX with @ new one 


88) Faly, x, 


such that the solution in 87) is the unique optimum of Lyle). This 
may be done eseily-by assigning eny values yp, >0toid J, p, = 0 
for eS as wall as p, = 0. Then choese any set of V, go that 6, *0 
for Je} end 6, <0 for jg}. Since L,(e) has a unique non- | 
degenerate solution we may use methods already described to trace out 
the set of points which give miniuum V(e) for given ¥ until A, = 0. 
If only a few bases are feasible for Ly(e), 1.e., if not toc many bases 
are optimal for La(e), Ay © O will be reached quickly. At toy + 0 
cither hy, = 0 or hp > 9. in the former case ve have arrived at a point 
with minimun V end cosximm B. In tho latter ose ve have X and are 
ready to trace cut the sot of effleiont X's. Fron this point on we 


1et dy 2 0, L.6., we demore F comletaly. Binco at dy = 0, v, > 0 for 
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all k ¢ X ve my refuce A, until ve intersect @ plane v, = 0 end 
comtinue as in section 6. 


If B is unbounted procedure 4 of section 12 can be used to fin! } 
the point X with minimum V. The efficient set can then be traced cut 

in the direction of increasing ee Bince there are only a finite 

number of critical lines end each critical Lins is effielent at most 

once the efficient set is traced out in a Minite mumber of steps. 


LL. _ The Set of Efficient BV Combinations 
Once the set of efficient X's 1s found the set of efficient B,V 


combinations oan be obtained easily. The critical line of a subspace 
in which more than one value of B is obtainable my be expressed as 
the solution to 


89) - Ons X + 2 =n, Je, , + (-r») wy 0, je 3 
90) £ ay, %; = Dis ie & 
91) uy X 


for -0o< EB < + 00 


Tf we let i be the inverse of the uatrix N in 80), 90}, 92) we have 


#8 () 
m recrans) G) streamer (2) 


fron which it follows that along any such critical line V and E are 


related by a formula of the form 
gh) Voa+bb +. 
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Thug the set of efficient B,V casbinations is plecewise parabolic. 

We know, or can easily get, the values of E ani $y @t the ead points 
of each of the pieces. We can also evaluate V at ZX. Enowing V at 
one value of B ant $F = b + 20% at two values of B ve can solve for 
the a, b, enic in 94) for tha seguent from B to BF - ¢,. Having a, b, 
and c we can evaluate V at EB - ec, by means of 94). This provides us 
with the value of V at one value of E on the seguent which is efficient 
from E - ¢, to - 5. This, combined vith the values of Fy at two 
values of E, allovs us to obtain the a, b, ¢ of 94) for this next 
segment--end so on until we trace cut the set of E,V combinaticna. 


12. Minints & tic 

Cne of the “by-products” of the calculation of efficient sets is 
the point at which V is a minim, i.e., where Ay « 0. fhe computing 
procedures described in sections 6 through 0 ere analogous to the 
simplex method of Linear programming (es contrasted with the “gradient 
nethods® that have been suggested for both linear and non-linear pro- 
greming). Both the procedure described in the preceding section-- 
considered as a way of getting to mia V--and the simplex method require 
a finite mumber of iterations, each iteration typically taking a “jump” 
to @ new point which is superior to the ald. Each iteration makes use 
of the inversa of a mtrix which is a “slight” modification of the 
matrix of the previcus iteration. The success of the simplex method 
in linear progremeing suggests that it may be desirable to use a 
voriant of the “eritical line™ method in the quadratic case. 


“te Z does not oxtest we can evaluate ¥ at X and use the sam process 
"in reverce.” 
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Cux problem then is to minimize a quadratic 
V= by 3 x, x, 
sudjectto constraints 1), 2) and 3). We wish to tranalate this into 


@ provlex of tracing out an efficient set. Thie may be done in several 
Ways. . 

1. An arbitrary set of py can be selected and the efficient set 
traced out until 4, = 0. The ly should be selected so that the 
"artificial” B has a unique maxim. 

2. An equality, say, 

% a, %; xX, = Ly 
can be eliminated from 1). EB can be defined as 

Be D a, 5%, 
end the critical set traced out until E = b,- rBeb is reached 
before de = 0 the computing procedures of the last section mist be 
continued into the region of dy <0. While the points thus generated 


will not be effictent--for they do not give mx E for given V--thay 
do give min V for given BE. In particular they will arrive at the point 


of min V for 
Ba =2a,,X, = by 
3. An inequality, say, 
> 
Bai, %,2 Le 
can be eliminated from 2). & can be defined as 
Ea aba, x ; 


The efficient set is traced out until either EB = b. or else de = 0. 


If the former happens first the constraint is effective; if the latter 
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happens first the constraint is ineffective. In either ease the point 
associated with the firat of theses to occur gives min V subject to 1), 
2), and 3). 
\ 

kh, An initial guess %,...,%; which eatiefies 1), 2), aut 3) 
can be mide oni p, defined so that, given these iy, x is oxfictent. 
The efficient set can then be traced out until 4, = 0. To choose ) 
so that X° is efficient choose arbitrary positive valyes’of 2,- (Led) | 
ard yg Then cheose Us 80 thet 


"y 20 for x, not at its lower bound 


ny >0O for x, at its lower bound 


Ir x” is in the same subspace as the optimal solution, the latter is 
reached in one iteration. 


